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Abstract 

We investigate the hypergroup property for the family of orthogonal polynomials 
associated with the deltoid curve in the plane, related to the A 2 root system. This 
provides also the same property for another family of polynomials related to the G 2 
root system. 


1 Introduction 

The hypergroup property is a property shared by some orthonormal bases in proba¬ 
bility spaces which allows for the complete description of all Markov sequences and 
for multiplication formulas (see Section [2]) . It has been established for some families 
of orthogonal polynomials in dimension 1, and relates in general to some special 
structure of the underlying space. This is a quite powerful tool in many areas, rang¬ 
ing from pure analysis and Lie group to statistics and computer algorithms. Gasper’s 
theorem establishes this property for dissymetric Jacobi polynomials in dimension 
1 (see pa mug Eg), and is an extension of an earlier result due to Bochner con¬ 
cerning the symmetric case El El- Although many authors revisited this result, a 
very elegant proof of Gasper’s theorem was recently proposed by Carlen, Geron- 
imo and Loss in |8], arising from the study of Kac’s model in statistical mechanics. 
This proof relies on the construction of an auxiliary model, and may be extended in 
many other situations. The aim of this paper is to show how this technique applies 
in the particular case of one of the 2 dimensional extension of Jacobi polynomials, 
namely orthogonal polynomials on the deltoid domain (defined below in Section [3|) 
and associated to the A 2 root system. 

Jacobi polynomials is the unique family of orthogonal polynomials in dimension 
1 (together with their scaled limits Hermite and Laguerre polynomials) which are at 
the same time eigenvectors of a second order differential operator, and more precisely 
of a diffusion operator m- Although there is no reason a priori for these two prop¬ 
erties to be related, it is worth to study the hypergroup property for other families 
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of such orthogonal polynomials in higher dimension. Among these orthogonal poly¬ 
nomials associated with diffusion operators, some of them arise from root systems, 
the Heckman-Opdam Jacobi polynomials pa ph. It is an open and challenging 
problem to analyse this question for these families in particular. Partial results have 
been obtained in this direction in |22l [23] in the BC n case. 

We investigate in this paper the family of orthogonal polynomials in dimension 2 
related to the deltoid curve and the A 2 and G 2 root systems, introduced by mm 
I18| . as one as the special families of orthogonal polynomials in dimension 2 which 
are at the same time eigenvectors of symmetric diffusion operators (see [3] and 
Section The scheme of Carlen-Geronimo-Loss relies in a crucial way on the fact 
that the polynomials are eigenvectors of some operator, and that the corresponding 
eigenspaces have dimension one. In the context that we investigate, this last property 
fails to be true, and this introduces some extra complexity in the formulation of the 
main hypergroup property result in Section [6j This difficulty arises from a symmetry 
invariance in the deltoid model. To get rid of this difficulty, we may look at simpler 
forms of the deltoid model, that is consider only functions which are invariant under 
this symmetry. This leads to investigate a new model, related to the G 2 root system, 
for which the hypergroup property takes the usual form. 

The paper is organized follows. In Sectional we present the hypergroup property 
and the elegant approach initiated by Carlen-Geronimo-Loss [8] to obtain it. In 
Section [31 we introduce the language of symmetric diffusion operators, which be 
used through the rest of the paper. The deltoid model is described in Section 01 
where we give some details about the structure of the eigenspaces, and show the 
relation with the A 2 root system, through some geometric interpretations of the 
associated operators for two distinct values of the parameter. The Carlen-Geronimo- 
Loss methods relies on the construction of some other model space (in general in 
higher dimension), which projects on the model under study and have some extra 
symmetry. This model (in our case 6-dinrensional) is presented in Section [5l Then 
we give in Section [6] the hypergoup property for the deltoid model itself, and finally 
in Section 01 we introduce the projected model related to the G 2 root system on 
which the hypergroup property presents a simpler form. 


2 Hypergroup property and Markov sequences 

The world hypergroup had been first introduced in 1959 by H.S Wall [24] . to gen¬ 
eralize the notion of a group, when the product of two elements is the sum of a 
finite numbers of elements. Different generalizations had been put forward by C. 
Dunkl,f9] Jewett US], see also the exposition book [5|. In our context, we shall 
mostly be concerned by the hypergroup property, as defined in [2], and which con¬ 
cerns some properties of orthonormal bases in £ 2 (/i) spaces, where /i is a probability 
measure, and that we describe below. 

Let (X, A, fi) a probability space, for which some orthonormal basis of £ 2 (/r) 
is given, which we suppose countable, and therefore ranked as (/o, fi, ■ ■ ■ , f n , ■ • ■ )• 
We suppose moreover that /o = 1. A central question which arises quite often 
is to determine all sequences (A n ) such that, if one defines a linear operator K : 
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jC 2 (fi) i —y £ 2 (/r) through K(f n ) = X n f n , then this operator is Markov. This means 
that K( 1) = 1 and K(f) > 0 whenever / > 0. Of course, the first condition 
reduces immediately to Ao = 1 and the difficulty is to check the positivity preserving 
property. We call such sequences Markov sequences, and the problem is known as 
the Markov Sequence Problem (MSP in short). 

When En A n < oo, the operator K may be represented through the <S> /u) 
kernel k(x,y) = En ^nfn(x)fn{y) and, since all the functions f n (except /o) satisfy 
/ f n dfi = 0, the previous series is oscillating and positivity may not be checked 
directly from this representation. 

The real parameters X n are the eigenvalues of the symmetric operator K, and it 
is well known (and quite immediate) that, if K is Markov, they must satisfy |A n | < 1. 
It is obvious that if A = (A n ) and p = (p n ) are Markov sequences , the ( X n fj, n ) is a 
Markov sequence. Moreover, for any 9 E [0, 1 ], 6X + (1 — 9)y = (9 X n + (1 — 9)n n ) 
is again a Markov sequence, and the simple limit of Markov sequences is again 
a Markov sequence. Therefore the question boils down to the determination the 
extremal points in the set of Markov sequences. The hypergroup property allows for 
such description. 

The hypergroup property holds when there exists some point xq € X such that, 
for any i£l, the sequence is a Markov sequence. Of course, for this to make 

sense, one needs for example some topology on X and require the functions (/ n ) to 
be continuous for this topology. 

When the hypergroup property holds, then these sequences j 71 ^^ are automat¬ 
ically the extremal points for the Markov sequence problem (see [2]) and then, for 
any Markov sequence (A n ), there exists a probability measure v on such that 

( 2 . 1 ) X n = f jj^-iy(dx). 

JX fn{X 0 ) 

To understand this representation, one should first extend the operator K by 
duality as an operator acting on probability measures. Since formally, 6 Xo has a 
density which may be written as E ?t fn( x )f n (xo), then K(5 Xo ) may be written as 
{J2n^rifn(x)f n (xo))dfi(x) and, with v(dx) = K(8 X0 ), one has 


f fn(x ) 

J fn(x 0 ) 


u(dx) = X n 


This of course is not really meaningful beyond the case of finite sets, and one 
should replace 8 Xo by a smooth approximation of it. It what follows, we shall have a 
symmetric diffusion operator L with eigenvectors f n , and the associated heat kernel 
Pt = e tL will be such that Pt(8 x ) has a bounded density with respect to \i for any 
t > 0 and any x. One may then replace 8 Xo by Pt(8 Xg ) in the previous argument, 
and let then t —> 0 to get the representation 

When the space X is a finite set, is is a consequence of the definition that this 
point xq must be the point with minimal measure (see 12 ]). Moreover, provided we 
chose the signs of (/„) such that f n (x o) > 0, it is immediate (and does not require 
the finiteness of the space X) that the functions f n reach their maximum (and the 
maximum value of their modulus) at xq. 
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This hypergroup property is strongly related with product formulae (see [19]). 
Indeed, assume that for any x € fl, the Markov kernel K x with eigenvalues 
has a £ 2 integrable density 

K x{f)(y) = j f{z)k(x,y,z)y(dz). 


Then, it is readily seen that 


K(x,y,z) 


E 


fn{x)fn{y)fn(z) 

fn(x o) 


is a symmetric function of (x, y, z ) and we get a product formula 


(2.2) fn{x)fn(y) = fn{x 0 ) J f n (z)K(x,y,z)y(dz). 

In [8], the authors provide a new and elegant proof of Gasper’s result, through 
a method which proves to be efficient in many other situations, and that we shall 
describe now. For this, we first require some topology on X and the functions (f n ) 
to be continuous for this topology. 

We assume that there exists a self-adjoint operator (in general unbounded and 
defined on a dense subset T> C C 2 (y)) L:Pi-> C 2 (y)) for which the functions f n 
are eigenvectors, that is L f n = y n fn- Moreover, we assume that the eigenspaces of 
L for the eigenvalues y n are simple. In our context, one may chose V as the set of 
the finite linear combinations of the functions _/). 

We also assume the existence of an auxiliary probability space (Y, B, v) with 
a self adjoint operator L, again defined on a subset T> C C?(v\ L : T> H > £ 2 {y\ 
together with some application n : Y H > X. For a function / : X H > R, we denote 
by 7r(/) : Y i —> M, the function 7r (f)(y) = f(n(y)). We suppose that ir(T>) C T> and 
that L7T = 7 tL. This property is often described as " L is the image of L under 7r" , 
or that "L projects onto L under 7r", or even that m 7t intertwines L and L". 

Moreover, one requires some measurable transformation <F : Y i —> Y which com¬ 
mutes with the action of L. That is, once again denoting d > (/)(y) = /(^(y)), we 
assume that T : V i —> V and L<F = <I>L. 

In order for the next proposition to make sense, we shall impose some topology 
on Y, and require 7r and T to be continuous. 

Let £ be a random variable with values in Y, distributed according to v. From 
the hypotheses, if is quite clear that the laws of 7r(£) and of 7r( < I > (^)) are y. We 
look at the conditional law k(x,dy) of 7r(<I > (^)) given 7r(£), where x i —> k(x,dy) is 
continuous for the weak topology. 

Proposition 2.1. Assume that there exist some point xq € X such that the condi¬ 
tional law k{xQ,dy ) is the Dirac mass at some point x\ G X. Then, the sequence 
A n = is cl Markov sequence. 

Proof. — 
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We consider the correlation operator, defined as 


K (f)( x ) = J f(y)k(x,dy). 

It is a Markov operator by construction. The assumption tells us that, for / continu¬ 
ous, K(f)(x o) = f(x 1 ). We shall see that this operator K corresponds to the choice 
of the Markov sequence (g n ) = ■ By definition of the conditional expectation, 

for any pair of C 2 {g) functions 

f fK{g)dn= [ f(n(y))g(ir(<S>(y))v(dy)= f Tr(f)$Tr(g)dv. 

Jx Jy Jy 

We want to show first that for any n, f n is an eigenvector for K. For this, chose any 
p and consider 

/ L fpK(fn)) = f irL(f p )$ir(f n )dv = f L'K(f p )$TT(f n ))di' 
j x d y J y 

= J^'K(fp)L$Tr(fn)dl> = J 7!-(fp)^TTL(f n )dv 

= A n [ n(fp)$n(f n )di> = X n ( fpK(f n )dn- 
Jy Jx 

Therefore, this being valid for any p, K(f n ) is an eigenvector for L with eigenvalue 
X n . Since the eigenspaces are one dimensional, we deduce that K(f n ) = fi n f n . 
Applying this at the point xq, we see that g n = . 

■ 

If we have at disposal a full family of such transformations <F such that the asso¬ 
ciated points x \(depending on <3?) cover X, we conclude to the semigroup property. 
The main challenge for proving the hypergroup property, when we have a basis given 
as eigenvectors for some operator L, is then to construct the space Y. the operator 
L, the projection n and the transformations $ : F 7, which satisfy the required 
properties. This is what we are going to do for the deltoid model in Section [5j 

3 Symmetric diffusion operators 

We briefly recall in this Section the context of symmetric diffusion operators, fol¬ 
lowing [Q, a specific context adapted to our setting. 

For a given probability space we suppose given an algebra A of func¬ 

tions such that A C ni< p <oo£ p (/r), where A is dense in C 2 (g). A bilinear application 
T : A x A A is given such that, V/ € A. T(f, /) > 0. If : W 1 i->- R is a smooth 
function such that for any (/i, ■ ■ ■ , f n ) € A n , $(/i, • • • , f n ) G A, then 

rw/i,- J k ),g) = Y / ^T(f l ,g). 

i 

A linear operator L is defined through 

(3.3) f fL(g)dg = -[ T(f,g)dg 

Jx Jx 
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and we assume that L maps A into A. We extend L into a self adjoint operator and 
we suppose and that A is dense in the domain of L. 

Then, for / = (/i, - - - ,/fc), and again if <f> is smooth with , f n ) in A 

whenever fi E A, then 

k k 

(3.4) l (*(/)) = e mm/i) + E d h^f)nfu /,•). 

i * j=i 

We have from (13.41) 

r(/, 5 ) = i(L(/ 5 )-/L( 5 )- 5 L(/)). 

If X is an open domain in M d , of some smooth manifold, then, in a local system 
of coordinates (x 1 , ■ ■ ■ , x d ), L may in general be written as 

(3-5) L (/) = E + E h% ( x ) d if’ 


while 

(3-6) r(/,^) = J^gVWdrfdjg, 

ij 

where g lJ = T(x*,x J ) and b l = L(x*). The non negativity of T translates into 
the fact that the symmetric matrix ( g lJ )(x ) is everywhere non negative. Moreover, 
g l] (x) = T(x*,x J ) and b l (x) = L(x*). Observe then that in order to describe L, we 
just have to describe L(x*) and T(x*,x J ). 

When the measure g has a positive density p with respect to the Lebesgue mea¬ 
sure, then the symmetry property of L translates into 

(3.7) L = - E di (g 10 pdj^J , 

^ ij 


which shows that, in formula (13.51) . 

(3.8) bi = E 9jg lJ + g lJ dj log p, 

j 

and this formula may be applied in many circumstance to identify the measure 
density p up to some normalizing constant. Since we shall mainly use this setting 
for finite measure, we may always assume with no loss of generality that g is a 
probability measure. 

A central question is to determine on which set of functions one apply the op¬ 
erator L, particularly when fi is bounded. Indeed, this requires to look at some 
self adjoint extension of L, and one needs in general to describe an algebra of func¬ 
tions which is dense in the domain of L and on which the integration by parts 
formula (13.31) holds true. This is done in general by prescribing boundary conditions 
on the functions /, such as Neumann or Dirichlet conditions. 
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In our setting however, we will always work on bounded open sets llcl'* with 
piecewise smooth boundary <917. Our functions g lJ and b l will be smooth in 17. 
Moreover, (p (x) will be defined and smooth in some neighborhood of 17. Then, 
suppose that in a neighborhood V of any regular point x of the boundary, the 
boundary may be described through {i 7 = 0}, where I 7 is a smooth function, defined 
in V and with real values. Then, our fundamental assumption is that 

(3.9) T(F, Xi) = 0 on <917 n V. 

When this happens, we may chose for A the algebra of smooth compactly sup¬ 
ported functions defined in a neighborhood of 17, referred in what follows as "smooth 
functions", and the integration by parts formula (13.31) holds true for those functions. 
In other words, for such operators, there is no need to consider boundary conditions 
of the functions in A (see [3]). In the context of orthogonal polynomials on bounded 
domains that we shall consider, this property is always satisfied (see 0 )- 

We shall make a strong use of the notion of image operator, to fit with the setting 
described in Sectional Suppose that we have a set of functions X = ■ ■ ■ ,Xp 

for which 

L(X i ) = B i {X),T{X i ,X j ) = G ij (X), 

then, of any smooth function <f> : i —> K, and thanks to equation (|3.4I) . one has 

U$(X))=L 1 ($)(X), 

where 

L 1 = '£G ii $ j + 'ZB i d i . 

ij i 

This is again a symmetric diffusion operator, defined on the image 17 1 = X(J7), and 
its reversible measure is the image of /r through X. This new diffusion operator Li 
is therefore the image of L under <3?, in the sense described in Section [2]: $Li = LT 
by construction. 

In the next sections, we shall always work on polynomials, moreover in even 
dimensions 2k. We shall suppose that the coordinates are paired as (x p ,y p ),p = 
1, ■ ■ ■ , k. In this context, it is often quite simpler to use complex coordinates (that 
is identify ~ C k ), setting z p = x p + iy p , z p = x p — iy p and one has to describe 
then, using linearity and bilinearity T(z p , z q ),T(z p , z q ),T(z p , z q ), together with L(z p ) 
and L(z p ). 

For example, T(z p , z p ) = T(x p , x p ) - T(y p , y p ) + 2 iT(x p , y p ). 

The positivity of the metric here may be checked according to the parity of k. 
For example, a careful inspection shows that indeed, the determinant of the metric 
in the variables (z p ,z p ) is (— l) fc 4^det(g), where the determinant computed in real 
variables. 


4 The deltoid model 


The deltoid curve is a degree 4 algebraic plane curve which may be parametrized as 


x(t ) 


-(2 cos t + cos 2t), y(t) 


1 

— (2sint — sin 27) 
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Figure 1: The deltoid domain. 


The factor 1/3 in the previous formulae are just here to simplify future compu¬ 
tations, but play no fundamental role. The connected component fl of the comple¬ 
mentary of the curve which contains 0 is a bounded open set, that we refer to as 
the deltoid domain. It turns out that there exist on this domain a one parameter 
family lh A ) of symmetric diffusion operator which may be diagonalized in a basis of 
orthogonal polynomials. It was introduced in [Ml EH, and further studied in [ 25] . 
This is one of the 11 families of sets carrying such diffusion operators, as described 
in [5]. 

In order to describe the operator, and thanks to the diffusion property (13.41) . it 
is enough to describe T(x,x), T(x,y), T(y, y), lh A l(x) and ld A )(y) (the operator T 
does not depend on A here). 


The symmetric matrix 


is referred to in what follows as the 


' r(x,z) r(x,y) N 

,r (y,x) r (y,y) j 

metric associated with the operator, although properly speaking it is in fact a co¬ 
metric. We may also use the complex structure of R 2 ~ C, and the complex variables 
Z = x + iy, Z = x — iy, and it turns out that the formulas are much simpler under 
this description. 

The operator ld A ) is then described as 


(4.10) 


'r(z, z) = z- z 2 , 
r(z, z) = z -z 2 , 

T(Z,Z) = 1/2(1 - ZZ), 
L(Z) = -XZ,L(Z) = -A Z, 


where A > 0 is a real parameter. 
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The boundary of the domain 17 turns out to the the curve with equation 


p(z, z ) := r(z, z ) 2 - r(z, z)r(z, z) = o, 


and inside the domain 17, the associated metric is positive definite, so that it corre¬ 
sponds to some elliptic operator in 17. Moreover, for this function P, the boundary 
condition (13.91) is satisfied, with 

T(P,Z) = —3ZP, T{P,Z) = -3 ZP. 


The reversible measure associated with it, easily identified through equation (13.81) . 
has density C Q P(Z, Z) a with respective to the Lebesgue measure, where A = ^(6a + 
5), and is a probability measure exactly when A > 0 (see |25j for more details). We 
shall refer to this probability measure on 17 as 

It is quite immediate that the operator commutes with the transformation 
Z i—)• Z . Indeed, there is another invariance : the transformation Z H > e l9 Z com¬ 
mutes with provided e 3 * 0 = 1. Therefore, everything is invariant under Z i— > jZ 
and Z i —y jZ, where j and j are the third roots of unity in the complex plane. 

From the form of the operator, we easily see that maps the set V n of poly¬ 
nomials with total degree n (in the variables (Z, Z) or equivalently in the variables 
(x, y )) into itself, and being symmetric, may be diagonalized in a basis of orthogonal 
polynomials. We refer to [25] for a complete description of these polynomials. In 
what follows, and it the rest of the paper, we shall forget the dependance in A of the 
polynomials, in order to have lighter notations. 

The eigenspaces of are described in [25] , For any (k,n), there is a unique 
polynomial R Ut k which is a eigenvector with eigenvalue — \ n ^ = —((A — l)(n + k) + 
n 2 + k 2 + nk ), which is a polynomial in the variables (Z, Z) with real coefficients, 
and has a unique highest degree term Z n Z k . When n ^ k, the eigenspaces have 
dimension 2, and we want to distinguish between the symmetric and antisymmetric 
part, under the symmetry Z i—)■ Z. We therefore chose when n ^ k the basis 
h{Rn,k + Rk,n ) an d ^j{Rn,k ~ Rk,n )• The following proposition summarizes a few 
properties of this basis of eigenvectors. 

Proposition 4.1. For any A > 0, for any n,k S N 2 , with k ^ n, there are exactly, 
up to a sign, two real valued polynomials P n k (Z, Z) and Q n k (Z, Z), with degree n+k, 
P n k being symmetric and Q n antisymmetric under the symmetry (Z,Z) i —> Z,Z), 
with norm 1 in C 2 (y\), such that 


^Pn,k ^ Qn,k n,kQn,ki 


where A nj fc = (A — 1 ){n + k) + n 2 + k 2 + nk. 

When n = k, there is exactly one such eigenvector P n ^ n , with eigenvalue —A n ^ n , 
and it is symmetric in ( Z , Z). 

Moreover, P n ^ has real coefficients, Q n ,k purely imaginary ones, and they satisfy 
(4.11) P njk (jZ,jZ) + iQ njk (jZ,jZ) =j n ~ k (P njk (Z,Z) + iQ njk (Z,Z)). 
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Observe that P n . k and Q U)k are real valued. We shall investigate the hypergroup 
property in terms of this basis. In order to have lighter notations, we shall often 
write P n . k (Z) and Qn tk {Z) instead of P nk (Z,Z) and Q nk (Z, Z), although they are 
really polynomials of both variables Z and Z (in particular, they are not harmonic 
in C). Moreover, recall that we shall by convention set Q n , n = 0. 

Proof. — Let R n k (Z, Z) the unique eigenvector with unique highest degree term 
Z n Z k . From the invariance under conjugacy, then when n 7 ^ k, the conjugate of 
R nk , that is R n ^ k (Z, Z) is an eigenvector with same eigenvalue, and looking at the 
highest degree term, it is therefore R k ^ n (Z, Z). Due to the conjugacy invariance, 
Rn t k and R k ,n have the same norm. 

For n 7 ^ k, let P n k and Qn,fc be the symmetric and antisymmetric eigenvectors 
of L^ with dominant terms \{Z n Z k + Z k Z n ) and 4/( Z n Z k — Z k Z n ) respectively, 
so that P n k and Q nk take real values, with Q nk vanishing on the real axis. (By 
convention, set Qn,n = 0)- The fact that j {P^ k ) 2 dfi\ = J(P k X ^) 2 dfj J \ (from the 
conjugacy invariance) shows that P nk and are orthogonal. Moreover, due 

to the invariance under Z 1 —)■ jZ. we know that P n , k (jZ) and Q n ,k{jZ) are again 
eigenvectors for L^) with the same eigenvalue, and therefore are linear combinations 
°f Pn,k and Q nk . Looking at the highest degree terms, one sees that 


(4.12) 


Pn.kiiZ) = ’ )P„. k (Z) | /( ' )Q,,k[Z). 

Qn,k{jZ) = -i{ J - - ^ - )Pn,k(Z) + (l -±2-)Q n ,fc(Z). 


ci n - k -l n ~ k ' 


In other words, (P n>k + iQ n)k ){jZ ) = j n k {P n , k + iQ n ,k){Z). As a consequence, 
since / P n , k (jZ) 2 d^ x = f Pn,k(Z) 2 d{i x , one sees that ||Ai,fc || 2 = \\Qn,k \\ 2 when n ~ 
k ^ 0 mod (3). We do not know if this is true for n = k mod (3). Of course, the 
problem does not exist when n = k. 

We therefore may use the basis P nyk = a nt kP n ,k and Q n ^ k = b n:k Q Utk as an 
orthonormal basis for the eigenspace associated with the eigenvalue \ ntk , with a nyk = 
b ntk when n — k jk 0 mod (3), and then equation (|4.12|) translates into (14.111) . If 
n — k = 0 mod (3) , then (14.121) is trivial since in this case P n>k (jZ) = P njk (Z), 

Qn,k(jZ) Qn,k(Z). I 

There are two particular cases which are worth understanding, namely A = 1 
and A = 4, corresponding to the parameters a = ±1/2. These two models show the 
relation with the A 2 root system, and indeed our polynomials are the examples of 
Heckman-Opddam polynomials associated to this root system. We briefly present 
those two models, referring to |25| for more details. 

In the first case A = 1, one sees that this operator is nothing else that the image 
of the Euclidean Laplace operator on M 2 acting on the functions which are invariant 
under the symmetries around the lines of a regular triangular lattice. 

Indeed, consider the three unit roots of identity in C, say (ei, 62 , 63 ) = (l,j,j). 
Then, consider the functions 4 : C C which are defined as 

(4.13) z k (z) = e m ^ k \ 
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They satisfy \zk\ = 1 and z\Z2Z3 = 1. 

For the 2 dimensional Laplace operator, the functions Zi satisfy 


A(zi) = -Zi,A(zi) = -Zi , 

and, if we denote for i ^ j € {1,2,3} by c(i,j) the index in {1,2,3} which differs 
from i and j, that is = {1,2,3}. 


(4.14) 


r (zi,Zi) = -z 2 , r (zi,Zi) = -z 2 , T(zi,Zi) = 1 

< 

T(zi,Zj) = r (zi,Zj) = \ z c (ij), r (zi,Zj) = \ziZj , i + j 


Let now Z = \(z\ + z% + £ 3 ). It is easily seen that, for the Euclidean Laplace 
operator on l 2 , Z and Z satisfy the relations (14.101) with A = 1. Moreover, the 
function Z : C C is a diffeomorphism between the interior 14 1 of the triangle T 
and 14, where T is one of the equilateral triangles which contains the two edges 0 
and 47 t/ 3 . The functions which are invariant under the symmetries of the triangular 
lattice generated by this triangle T are exactly functions of Z. In particular, the 
application (zi, z-i) e -Z = \{z\ + Z 2 + Z 1 Z 2 ) maps 5 1 x 5 1 onto the closure of the 
deltoid domain 14. The boundary of 14 is the image under Z of the boundary of 
the triangle, and also of the set where 2 of the three variables (zi, ^ 2 > £ 3 ) coincide. 
The cusps of the deltoid model are the images of the points z\ = 22 = ~3, that is 
Zi = 1 , j,j)- 

In particular, the set of all the points Z = ^{z\ + Z 2 + 23 ) such that \zi\ = 1 and 
Z 1 Z 2 Z 3 = 1 is the closure of 14. Indeed, given Z € 14, there exist, up to permutation, 
3 unique and distinct complex numbers z, satisfying \zi\ = 1 and Z 1 Z 2 Z 3 = 1 such 
that Z = ^(zi + Z2 + Z3). They are the three distinct roots of the equation P(X) = 
X 3 — 3 ZX 2 + 3 ZX — 1 = 0. It is worth for this to observe that the discriminant of 
P is, up to a numerical constant, equal to P(Z, Z), and therefore does not vanish in 
14. 

The second description comes from the Casimir operator on SU(3). For SU(d ), 
one may describe this operator through its action on the various entries Zij of the 
matrices g € SU(d). Up to some scaling factor, one has 

T su ( d \zij, z ki ) = ZijZ k i - dzuZkj , 

T ^ - (Zj : j , Zki) — ZijZki dzuZkj, 

L ^ ' (zij , Zki) — ddikSji ZijZki 

L su{ - d \zij) = -(d 2 - 1 )zij, L su ^(zij) = -(d 2 - 1 )zij 

Then, choosing Z = + Z 22 + - 233 ), one obtains the relations (14. lOj) with A = 4 

when applying |L 5[/ (3) to functions of Z and Z. For this particular case, we may 
make full use of the group structure of SU(3) to obtain the hypergroup property 
for the deltoid model, at any of the points Z = 1, Z = e 2 * 71- / 3 , Z = e 4 * 71 '/ 3 . It is 
enough to follow the scheme described in Section [2] chosing Y = SU(3), 7 r being 
the application which to some matrix g € SU(3) associates ^trace (g), and being 
3 H>• gog, for any go € SU(3). . If 7r (g) = 1 for example, then g = Id, and the 
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conditional of 7 r( 3 >(< 7 )) knowing that ir(g) = 1 is the Dirac mass at n(go). However, 
the eigenspaces being two dimensional, this introduces some extra complexity that 
we shall examine in Section [ 6 ] 

Similarly, using the representation for A = 1, we may also prove the hypergroup 
property in this case, using the translations in M 2 . 

Our aim in what follows is to propose another 6 -dinrensional model which projects 
onto the deltoid model in the general case (that is for A 7 ^ 1,4), and on which we 
have enough symmetry to use the machinery described in Section [2j 

5 A 6-dimensional model for the deltoid 

In this section, we construct a symmetric diffusion operator La in dimension 6 (or 
more precisely on an open bounded set Hi C C 3 ), such that the image of the operator 
La under the projection n : C 3 >->• C which is 7r(zi, Z2, 23) = |(zi + Z2 + £3) is exactly 
our deltoid model with parameter A. Moreover, this operator may be diagonalized 
in a complete system of orthogonal polynomials for its reversible measure. 

We consider a diffusion operator in C 3 , acting on 3 complex variables zi,Z 2 ,z^, 
defined as follows. We set 


r (zi,Zj) 

3 _ 

2 ^c(i t j) ZiZj 

for ; 


f (Zi,Zj) 

= 2 Z c(i,j) ~ Zi.Zj 

for 


f (Zi,Zi) 

- - z 2 

^1 



f (Zi,Zi) 

- -z 2 

*l 



r(zi, Zj ) 

— 3a. • _ L.r. 

— 2 U V 



L (zi) = 

-A Zi, L (zi) = —Xzi, 




where as before c(i,j ) the index in {1,2,3} which differs from i and j. It is worth 
to observe that those relations fit with (|4.14|> whenever \z {| = 1 and Z 1 Z 2 Z 3 = 1, so 
that those equations may be seen as an extension of (14.1411 in the interior of some 
domain bounded by those equations. We shall see hat it is indeed the case, when 
we shall describe the domain. 

The first task is to observe that L projects onto the deltoid model in the sense 
of Sectional with the same parameter A. 

Proposition 5.1. For z = (z\,Z 2 ,zz) € C 3 , let n(z) := Z = \{z\ + Z 2 + 23). Then, 
one has 

'T(Z,Z) = Z- Z 2 
f(Z,Z) = Z-Z 2 
( f(Z,Z = l(l-ZZ)) 

L(Z) = —XZ, L (Z) = -A Z 

This comes from an immediate computation. We see that these computations fit 
with formulae (I4.10p . 
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The next task is to show that this corresponds to some elliptic symmetric diffusion 
generator in some bounded domain C C 3 . 

For this, let us introduce the following notations. We write Zj = with 

Tj = \zj\, and 

'9 = 8^82 + 63 

51 = r\ + r 2 + rf, 

5 2 = rf + r% + r\ 

a = r\r 2 T 3 cos(@) 

and let 

/ 5 lg , f Pl( 21 , 22 , 23 ) = 2 - (Si + l ) 2 + 25*2 + 8 a. 

\P2 (zi,Z 2 ,Z3) = 2(S 2 - 1) - (5! - l) 2 . 

Let us describe the domain first. Let D be the determinant of the matrix T 
(in both coordinates (zi,Zi)). Then, define to be the connected component of 
C 3 \ {D = 0} which contains (0,0,0). 

Proposition 5.2. We have 

1. D = |PiP 2 ; 

2. The operator L is elliptic in fli; 

3. f^i is bounded; 

4- Pi > 0 on Oi and P 2 <0 onTli. 

5. The boundary of Q 1 is included in {P\ = 0}. 

Proof. — The first item results from a direct computation. Since it is straightforward 
although quite technical, we recommend that the reader uses a computer program 
to check it. 

For the second item, let us observe that the metric at 2 = (0,0,0) is the classical 
Euclidean metric of C 3 , up to some scaling factor. Therefore, it remains elliptic as 
long as no eigenvalue of the metric vanishes, that is in the connected component of 
the set {D 7 ^ 0} which contains {0,0,0}. It is therefore elliptic in fii. 

For the third assertion, observe that as long as T is positive definite, then one 
has T(zi,Zi ) 2 > T(zi, Zi)T(zi, Zi). This translates into (3 + r?)(l — rf) > 0 so that 
rj < 1 in Qi. 

We have P 2 (0,0, 0) < 0 and Pi(0,0, 0) > 0, so that, in fii, Pi > 0 and P 2 < 0. 

It remains to prove the last assertion. Any point 2 € satisfies Pi ( 2 ^ 2 ( 2 ) = 0. 
Let 2 = ( 21 , 22 , 23 ) € <9fli such that P 2 ( 2 ) = 0. We shall prove that we also have 
Pi ( 2 ) = 0 at this point. 

We know that Si > 0, and it is immediate that |S^ < S 2 < Sf. From the upper 
bound, we get P 2 < (Si — l)(Si + 3). Therefore, at a point where P 2 = 0, one has 
Si > 1. At such a point, we also have Pi = 4(1 — Si + 2a). 

We now want to estimate the maximum possible value of rir 2 r 3 on the set where 
P 2 = 0 and 0 < r* < 1. We shall see that this maximum value is (Si — l)/2. Setting 
Xi = rf. it amounts to look for the maximum value of X 1 X 2 X 3 on the set where 
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52 := Yli x 1 = 1 + ^(5 — l) 2 , where 5 = Yli x i and 0 < a;* < 1. Looking at the 
Lagrange multiplier, one sees that, if the maximum is not attained at the boundary 
of the set, then one must have 

£ 2 X 3 = A(1 + x\ — X 2 - x 3 ) 

< X 1 X 3 = A(1 + x 2 — xi — x 3 ) 

^X\X 2 = A(1 + x 3 — X\ - X 2 ) 

from which using 52 = 1 + |(5 — l) 2 , one deduces that 3A(3 — 5) = (5 — 1)(5 + 3) 
and therefore A > 0. Multiplying the first equation by x± we find then that 

7 r := X\X 2 X 3 = X(x1 + x\ + 2A(xi — 1)). 

The same relation being true for X 2 and x 3 , the values for Xi must lie among the 
two solutions of the equation 

7 r = A(x 2 + x + 2A(x — 1)). 

But 7 r > 0 and A > 0. Unless they are all equal, they may not be all positive. 
Therefore, either the maximum is attained at a point ( x,x,x ), in which case this 
common value is 1 and (5i — l)/ 2 , either one of the values for Xi is 1, and the fact 
that P 2 = 0 implies that the two other values are equal, in which case again the 
value is (5 — l)/ 2 . 

Therefore, when P 2 = 0, Pi < 1 — 5i + J*(5i — 1) = ^(1 — 5i) < 0. Since Pi > 0 
in Q 1 , then any point in <9fli which satisfies P 2 (z) = 0 also satisfies P\(z) = 0. 


Remark 5.3. It may be worth to observe that P\ may take a somewhat simpler 
form. Setting 

co = n + r 2 T r 3 
ci = -ri + r 2 + r 3 

< 

c 2 = ri — r 2 + r 3 
c 3 = ri +r 2 -r 3 

and 


5 = (1 + c 0 )(1 - Ci)(1 - cr 2 )(l - c 3 ) 
D = (1 - c 0 )(1 + Ci)(1 + c 2 )(l + a 3 ) 


one may write 

Pi = 5 cos 2 (9/2) + D sin 2 (6/2). 


Our next result shows that indeed the operator L defined on Hi satisfies the 
boundary condition 113.911 . 


Proposition 5.4. 

1. With P\ defined in (15.161) . one has 


(5.18) f (log(Pi),Zj) = — 3zj, f (log(Pi), Zi) = 
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2. For * = !,••• ,3, one has 


f Ylj =1 9 Zj T(Zj, Zi) + C^.f (Zj, Zi) — 2 z i 

\E?=1 + d- Zj t(zj,Zi) = 

Proof. — These formulas may be checked with a direct and tedious computation. 
However, we have no simple interpretation, beyond mere calculus, why this is true. 
The first one is the condition required for the operator L on fii to be diagonalizable 
in a system of orthogonal polynomials. The second will be used to identify the 
reversible measure. 


Remark 5.5. Together with the fact that T(zi,Zj), T(zi,Zj) and T(z,;, zj) are poly¬ 
nomials in the variables ( Zi,Zi ), and following & equation (j5. 18|) is the key identity 
which insures that the operator L may be be diagonalized in a basis of orthogonal 
polynomials. 

We now prove the following lemma 

Lemma 5.6. For any (3 > — 1, P^ dx < oo, where dx is the Lebesgue measure 

on fli C C 3 . 

Before proving Lemma [5.61 we deduce the following 

Corollary 5.7. For any A > 5/2, the operator £/ A ) is reversible with respect to the 
probability measure CpP^dx, where (3 = ^(2A — 11), dx is the Lebesgue measure in 
Hi, and Cp is the normalizing constant. 

Proof. — (Of Corollary 15.711 This is a direct consequence of the general formula (13.81) 
and Proposition 15.41 


Remark 5.8. It is worth to observe that /3 = — 1 corresponds to A = 5/2, while 

L(Pi) = —4(A + 2)Pi + (2A - 5)(P 2 - 3Pi)/6. 

This suggest that, for this precise value A = 5/2, the measure is concentrated on 
the surface {P\ = 0}, and the associated process lives indeed on the boundary of the 
domain Lli. 

Moreover, this limit (3 = 5/2 corresponds for the projected model on the deltoid 
domain to the case a = 0, that is when the reversible measure of the image operator 
on is the Lebesgue measure. 

Proof. — (Of Lemma 15.61) 

When looking at the behavior of Pi near a regular point of the boundary {Pi = 
0}, it is clear that the condition (3 > — 1 is necessary for pf to be locally integrable 
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near such a point, in the domain {Pi > 0}. But we have also to consider the behavior 
near singular points. Set as before 


' Sl =rl + r 2 2 + rl 
< S 2 = rj + r| + r|, 
J = rir 2 r 3 . 


and, writing z 3 = rje lBj , set t = 6± + d 2 + 0 3 . Then we have 

Pi = 2 — (Si + l)^ + 2 S 2 + 8 t cos(i), 

and we want to show that for /3 > — 1, Pf is locally integrable with respect to the 
measure r\r 2 r 3 dridr 2 dr 3 dt. on the domain 0 < < 1, t € (0, 27r), and Pi > 0. We 

set 

A = 2- (Si + 1) 2 + 2S 2 , B = 8r, 

The first thing is to compute 

(5.20) I(A,B) = [ (A + Bcos(t))Pdt 

J A+B cos(t)>0,tE(0,2-7r) 

/ I 7 

U.4+B»>0(^ + PH) g 

-i v i — « 

that we want to estimate up to some constants depending only on f5 . For this we 
write I ~ J when cp < -j < Cp, for two positive constants cp and Cp. 

We cut the integral in (|5.2ip into and f° 1 . Then we change variables to write 
both integrals as , and again change variables v H > 1 — v. Finally, we get 

I(A, B) ~ £ 11 a+B - Bv>0 (A + B- Bvf -^L + £ lU_ fl+Bt , >0 (A - B + ^) /3 ^- 

Write this I (A, B) = I\ + I 2 . 

Then 

J/i(A,P) = 0 if A + B < 0, 

\h{A,B)^{A + Bf +1 / 2 B~ 1 / 2 ifA + P>0 

and 

7 2 = 0 if A < 0, 

< I 2 ~ if 0 < A < B 

I 2 ~ A? ii 0 < B < A 

We now have to consider the integral of I\ and I 2 on the image of the domain fli 
through the projection ( 21 , z 2 , z 3 ) {r\, r 2 , r 3 ), that is the integral of I\ and I 2 with 

respect to the measure rir 2 r 3 dr\dr 2 dr 3 , on the domain {0 < r* < 1} H {A + B > 
0} PI {A — B > 0}. An easy inspection show that A + B = S and A — B = D, where 
S and D are given in formulae (15.171) . We see that I\ > C{lil 2 l 3 )P +l ^ 2 B~ 1 / 2 , where 
li are 3 independent affine forms, restricted to a domain where they are positive, 
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and C is a constant. Such a function is integrable with respect to the measure 
i? 1//2 lo<n<ilo<r 2 <ilo<r 3 <i^idr 2 dr 3 . This integral is finite when /? > —1. 

The only problem comes from f 0<B< ^ 0<r , <x A^rir 2 r 3 dridr 2 dr 3 - We see that 
one may reduce to a neighborhood of a point where both A and B vanish, which 
means that (up to a permutation of the indices) r\ =0, r 2 + r 3 = 1. Once again, 
integrating in a area where 0 << r 2 << 1 causes no problem, and it remains to 
consider the integral on an area where r 2 = 0, r 3 = 1 ( or symmetrically). Then, 
in a neighborhood of this point, we may bound A > A — B = D, and consider the 
integral of D 13 on D > 0. In this neighborhood, with the notations of Remark 15.31 
D is equivalent to (1 — cro)(l + 03 ), which is the product of two independent linear 
forms (in the variables 7 * 1 , 7 * 2 , ^" 3 ) , and is locally integrable as soon as /3 > — 1. 


6 Hypergroup property for the deltoid model 

For A > 5/2, the operator provides a symmetric diffusion operator on the set 
III which projects onto the deltoid model with the same parameter through the 
map 7t(z 1 ,z 2 , z 3 ) = |(zi + z 2 + z 3 ). 

We now observe that, for any 0 = (9\,9 2 ) € M 2 , the operator L is invariant 
under the transformations <£ 0 ( 21 , z 2 , 23 ) = {e l9l z 1 , e ld2 z 2 , e~ l ^ 1+e ^z 3 ). It is worth to 
notice that = &g 1+ g 2 , and that the measure fi a = P^dz is invariant under 

Tg. Therefore, if we define $>g(f)(z) = f($g(z)), one see that the adjoint of is 

To fit with the situation described in Section (2J it remains to identify the point 
Xq of Proposition 12.11 Let then xq = 7r(l, 1,1) = 1: it belongs to the boundary 
of fl. According to the analysis of the flat model (A = 1), 9 1 —> $#(1, 1,1) is onto 
the deltoid domain fi, and, when 9 varies in R 2 . Indeed, we have seen that any 
point in Q may be written as \{z\ + z 2 + z 3 ), where \zi\ = 1 and z\z 2 z 3 = 1, which 
corresponds to points $g(l, 1,1). 

Since \zi\ 2 < 1 for any point in f), then, \/z € II, |7r(~)| < 1, and if tt(z) = 1, 
then z\ = z\ = z 3 = 1. Therefore, 7r(^(zi, z 2 , z 3 )) = <I>6i(l, 1,1). This shows that 
the conditional law of ir(&g(z)) when 7 r(z) = 1 is a Dirac mass at ^(l, 1,1). 

Indeed, we may as well chose for xq the image of the points (j,j,j) or (j , j. j ), 
and those three points correspond to the cusps of the deltoid curve. Define Z(Q) = 
7r(($e(l,M))- Then , ^($e(j,j,j)) = jZ(9), and tt= jZ(0) 1 Moreover, 
the conditional law of z = \{z\ + z 2 + z 3 ) knowing that tt(z) = 1, j, j is a Dirac 
mass at Z(0), jZ(9) and jZ{9) respectively. The point Z{9) is in the interior of the 
deltoid domain as soon as 9\ ^ 0 2 mod (27r) and 26\ ^ —0 2 mod (2ir). Observe 
also that Z(—9) = Z{9 ). 

To apply the method described in Section [2l the only problem is that the 
eigenspaces associated with have dimension 2, when n 7 ^ k. They are in¬ 
variant under the symmetry Z 1 —>• Z, and the model also shares the symmetry 
S : (z\, z 2 , z 3 ) i->- (z 1 , z 2 , z 3 ). So instead of looking at eigenvectors of alone, one 
may look at eigenvectors of L ^- 1 which are symmetric, or antisymmetric, through the 
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transformation Z i->- Z, which leads us to consider the basis ( P n ,k,Qn,k ) described 
in section 3 J 

The transformation z >—?> <&e{z) is not invariant under the symmetry S. We 
have $g(z) = (z). Observe also that the operators $g(f)(z) = f($g(z)) satisfy 

g) = (/, <f >_6 >g), which comes from the fact that the measure is invariant under 
the symmetry S. 

From the general scheme described in Section [2l one sees that, writing the Markov 
operator K e (f) = E(f(ir($ g z))/ir(z) = Z ), that both K e (P ri}k ) and Kg(Q n>k ) belong 
to the eigenspace associated to the eigenvalue \ ntk , defined in Proposition 14.11 We 
have 


Proposition 6.1. With Kg(f)(Z) = K(f( tt(&qz))/ n(z) = Z), one has, for any 
A > 5/2, 

(K 0 (p n . k )\ = (a n , k (0) p n , k {e)\ (P n A 
\Ke(Q n , k ) J \7 n,k(0) 5 n , k (9)) \Q n J ’ 


with 


&n,k (0) 

< 


p n ,k{z{e)) 

P n ,k( i) ’ 


7 n,k(0) = ~Pn,k(9) = 

Moreover, one has ot n)k {9) = u n ,k(—9), ^n,k(~9) 


Qn,k(Z(0)) 

P n ,k( i) 

&n,k(.9'), nnd fd n ,k(.9) 


Pn,k( 9)• 


Proof. — It is enough to check this property for A > 5/2, since everything is 
continuous and we would have the same property in the limit A = 5/2. 

Equation (Kg(f),g) = (f,K-g(g)} proves the parity relations, choosing / and g 
either P n ^ k or Q n>k . 

If we apply Kg(f)( 1) = /(Z(#)), and using the fact that Q n , k ( 1) = 0, we get 
Pn,k(X)<*n,k{0) = Pn,k{Z(9)), and P n ,k{X)ln,k{9) = Q n ,k{Z(9)). This shows that 
P n ,k( 1) may not vanish (since it would imply that P n ^ k = 0 everywhere), and leads 
to the representation formula for a Uyk and 7 nj fc. The formula for /3 n k follows by 
symmetry, since Z{—9) = Z{9) and Q nyk {Z) = —Q n<k (Z). 


Remark 6.2. The value of 5 n ^ k (9) however is more difficult to obtain. One may 
apply the identity Kg(f)(j) = f(jZ(9)) and formulae (14. 12|) whenever n — k f 0 
mod (3), to get 

_ cos(2(n - k) 7t/3) P njk (Z(9)) 
n,k sin(2 (n - k)ir/3) P U)k { 1) 

This method, however, does not provide any information on 5 n k (0) when n— k = 0 
mod (3). 

The point xq = 1 corresponds to one of the 3 cusps of the deltoid curve, and is 
the image of one of the points of 5 1 x 5 1 X 5 1 where z\ = z^ = £3 and Z\ z-i Z 3 = 1. 
There are 3 such points, corresponding to the three cusps of the deltoid, and we 
could have similarly proved the hypergroup property for any of those points, but for 
another polynomial basis. The choice of the point xq = 1 corresponds to the choice 
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of the basis ( P n ,kiQn,k ) such that, under the symmetry S : Z i->- Z, SP ntk = P n ,k 
and SQ n , k Qn,k‘ 

We may as well consider symmetries which leave the two other cusps invariant, 
and this provides new bases for the eigenspace in which the operator Kg has a 
similar expression. A polynomial R is symmetric with respect to the symmetry 
through the j axis if R(jZ) = R(Z). Then, thanks to equation (14.111) . a basis 
(Rn,kiSn,k) °f the eigenspace associated with A n k for which the first element is 
symmetric and the second antisymmetric under the symmetry around the j axis 
would be R n ,k + i<S n ,fc = j n ~ k {Pn,k + iQn,k)- 0 ne also have the hypergroup property 
for the family ( R n ,k , S n ,k) and similarly for the family (U n>k , V n , k ) corresponding to 
the point j.This leads to other representations of the Markov operator Kg. 

As usual, the operators Kg lead to a full representation of Markov kernels. 

Theorem 6.3. Let K be a symmetric Markov operator, bounded in C 2 (p,^), with 
A > 5/2. Assume that K commutes with IAW Then, with the notations of Proposi- 
tion \f.l\ for any n, k E N 2 , it satisfies 

(Pi 99l f^i.^n,k)'\ fO"n,k bn,k\ ( Pn,k\ 

1 J \K{Q nik )) ~ \b n , k c n , k ) \Q n J 


and there exists a probability measure v\ on the deltoid domain Ll such that 

(6-23) a U)k = I P ™' k ^ v(dz), b U)k = f ®"' k ^ v{dz). 

J Pn,k{ 1J J Pn,k{ lj 


Proof. — 

We follow the lines of the proof described in Section [2] Equation (|6.22p is imme¬ 
diate from the fact that K commute with l/ A ) and the description of the eigenspaces 
of LW given in Proposition 14.11 Extending the operator K to act on probability 
measures, we choose v\(dz) = K(5\). If Pt denotes the heat kernel associated with 
L( a ), let u t = K[P t {5{)). Following [3], we know that Pt(8\) has a bounded density 
with respect to which may be written as k e~ Xn ’ kt P ntk (z)P n . )k ( 1), where this 

simplified form comes from the fact that Q nk ( 1) = 0. Then, the density ht of vt 
with respect to may be written as 

ht = y j e~ Xn ' kt P n , k {l){a n , k Pn,k{Z) + b n:k Qn,k(Z)), 
n,k 


and we see that 


f Pn,k(Z) 

J P n ,k{ 1 ) 


di't — 6 n,k a n k , 


/ 


Qn,k{Z) _n 

Kwi = 


■■ kt b 


n,k • 


Since vt converges to v = K{5\) when t 0, we get the result in the limit. ■ 

The previous representation relies in an essential way on the fact that Q n k (l) = 
0. This choice comes from the symmetry properties of the operator under Z i— > Z, 
that is the symmetry around the real axis. 
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In order to get informations about the coefficients c n ^ kl one may use the invariance 
of the model under Z H >■ jZ and Z H > jZ whenever n — k ^ 0 mod (3). One may use 
similarly the invariance through multiplication by j and j and symmetries with the 
corresponding axis. This means that a similar presentation is valid in the two other 
bases (R n ,ki Sn,k) and ( Un,k,Vn,k ) (using the symmetries leaving j and j invariant 
respectively). 

In this new basis, the matrix of the operator is unchanged when n — k = 0 
mod (3), while the matrix of the operator K in this new basis becomes, 


1 ( Q"n,k T 2e\/3^?2,/c d - 3Cn,k ^^n,k d - ^\/3p2,/c 

4 \ ty/^CLn^k ^bn,k d - £\/3 C n ^k 3a n ,k 2iC'^3b n ^ k d - C n ^ k 

where e = 1 when n — k = 1 mod (3) and e = — 1 when n — k = 2 mod (3). 

If_ we observe that (R Ujk + iS n>k )(jZ) = (P njfc + iQ n>k )(Z), so that R n ,kU) = 
Un,k(j) = Pn,kiX)i we get a new representation, with the measure = K(5j), when 
n — k ^ 0 mod (3) 

Rn,k(z') / » \ _ f Un,k(z) 

^ 11,~-. i* —t— jL,r \/ • /, —i— . if u i — i -7/1 \ fl.Z. ) — / 


d- 2e\/3+ 3c n;fc ) = J R p l ' k ^\ i(dz) = j U "' k ^ v 2 (dz) 


and 


P n ,k( 1) 

S n ,k{ Z ) . 


Pn,k{ 1) 


^(-e\/3a nifc - 26 nifc + eV3 c n , fc ) = J v\{dz) = j j^^v 2 {dz). 


This may be rewritten as 

Q"n,k 

ir 

bn,k 


— £ 


— £ 


.V3, 

2 ®n,k — 

f Pn,k{z) j ! , 

1 P„,W) d { 

v/3 

2 c n,k — i 

f Qn,k{z) j ( 

1 Pn. t m dv,(z 


Changing j into j amounts to change e into —e in the previous formulas, with 
the measure v 2 = K(5j). 

This in turn provides a representation of c n ^ k when n — k ^ k mod (3), of the 
form 

f QnM ( 2 1 J , ^ 

Unfortunately, this does not carry any information about c n)k when n = k 
mod (3). 


Remark 6.4. As we already observed, for A = 5/2, the 6 dimensional model is in 
fact carried by the algebraic hypersurface {Pi = 0}, and in fact is a 5-dimensional 
model. However, for other values of A (with the sole exception of X = 1), we do not 
know if the property is true. It would be intersecting to construct lower dimensional 
models for these values, but this seems quite hard. 


Remark 6.5. It would be interesting to have an explicit expression for the kernel 
Kg{x,dy), in order to have explicit representation for the product formula (12.21) . 
Unfortunately, the law of (Z, Rg(Z)) is already apparently quite out of reach through 
simple formulas. 
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7 Projection of the deltoid model and the GV 
root system 

As we saw in Section El the fact that the eigenspaces for L( a ) are two dimensional 
introduce extra complexity in the representation of the eigenvalues of the Markov 
operators which commute with L( a ). This works much better if we concentrate 
on functions which are symmetric in (Z,Z), which correspond to the symmetric 
polynomials P n ^(Z, Z). . It turns out that these symmetric polynomials are again 
orthogonal polynomials corresponding to another bounded set CK 2 , bounded by 
a cuspidal cubic and a parabola, tangent to each other at the second order. Going 
back to the triangle model, remember that the deltoid model in the case A = 1 
corresponds to functions which are invariant under the symmetries of a triangular 
lattice, corresponding to the root system A 2 . Adding this new invariance under 
Z i—^ Z amounts then to add new symmetries, namely with respect to the medians 
of the triangles, corresponding to the root system G 2 . Let us describe this new 
polynomial system. Setting s = Z + Z and p = ZZ , formulae (14.1011 give 

r(s, s) = p - s 2 T s T 1 , 

{7 2A) < T(s,p) = s 2 -2p-lsp + ^ 

T(p,p) = s 3 — 3 p 2 — 3 sp + p 
L( a )(s) = —As, L( a )(j>) = 1 — (2A + 1 )p 

Let us call £/ A ) this operator acting on functions (indeed polynomials) in the 
variables ( s,p ). 

From equation (17.241) . it is clear that the operator £( A ) preserves the set of polyno¬ 
mials in the variables (s,p) (this just translates the invariance of L^ under Z 1 —>• Z). 
However, because of the term p 3 in the coefficient F(p,p), it does not preserve the 
degree of the polynomial. But things work better if we decide that the degree of s r p t 
is s + 21 . Then, with this new notion of degree, a polynomial Q(s,p) of degree k is 
transformed under £/ A ) into a polynomial of degree k. One may therefore find an or¬ 
thonormal basis for ~L( a ) as polynomials in the variables ( s,p ). In fact, it is nothing 
else than the symmetric polynomials P n ^(Z,Z) expressed as polynomials in ( s,p ). 
Since now, the eigenspaces are one dimensional, one may play the same operation 
with the operator lA A ), but now with the projection T : Z 1 —)• \{Z + Z) = s, ZZ = p. 
We shall obtain the true hypergroup property for this polynomial family, through 
the projection fix i->- Rq(z) + Ro(z) = R$(z) + R_q{z). 

The image operator may be diagonalized in a family of orthogonal polynomials 
(in the variables ( s,p )) for the image measure. This model does not appear in the [4| 
classification, since in this case the orthogonal polynomials must be ranked according 
to a degree which is 2deg(p) + deg(s), whereas in [J], the polynomials are ranked 
according to their usual degree. The boundary of H 2 is indeed the set where the 
determinant of the metric vanishes. This determinant may be written as 

i(s 2 - ip)(3s 2 + 12 sp + 6 p- is 3 - 1), 
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and the boundary of fi 2 is a degree 5 algebraic curve. The curves s 2 — 4p = 0 and 
3 p 2 + 12 sp + 6 p — 4s 3 — 1 = 0 correspond respectively to the images under of the 
line Z = Z (the real axis), and of the boundary of 11 (the deltoid curve). It turns 
out that this last curve is a cuspidal cubic. Setting 

s = x — l,p = y — 2x + 1, 

(which corresponds to some affine change of coordinates), they are transformed in 

4x 3 — 3 y 2 = 0, x 2 T 6x — 4y — 3 = 0. 

These two curves (cubic an parabola) cross in the point (1/3, —2/9), and are tangent 
to the second order at the point (3,6) (in the variables ( x,y )). The cuspidal point 
in the cubic (0, 0) is the image of j and j in the deltoid (two of the cuspidal points 
of the deltoid), while the point (3,6) is the image of the third cusp of the deltoid, 
that is the point 1, which is also on the line Z = Z. 

Moreover, with Qi = s 2 — 4 p and Q 2 = 3 p 2 + 12 sp + 6 p — 4s 3 — 1, both Q\ and 
Q 2 satisfy an equation similar to equation (15.181) . and more precisely 

r(logQi,s) = —2s - 2, T(log Qi,p) = -3 p- 2s + 1, 
r(logQ 2 ,s) = -3s, r(logQ 2 ,.p) = -6 p 

This shows that the operator defined through equations (17.241) has reversible measure 
C\Q 1 1 ^ 2 Q^ 5 ^ G dsdp, which is of course the image of the measure through the 
projection 4'. This operator therefore satisfies the usual hypergroup property, with 
reference point the image of 1, which is (2,1), that is the point where the cuspidal 
cubic and the parabola are bi-tangent to each other. 

But from the general presentation of |4], there is now a two-parameter family of 
measures, namely p a ^(ds,dp) = Ca^Qi 1 Q 2 2 dsdp on this set fl 2 , for which there 
exist a family of orthogonal polynomials which are eigenvectors of a diffusion oper¬ 
ator. 

The conditions under which those measures are finite are oq > —1, a 2 > —5/6, 
and aq + a 2 > —4/3. The condition a 2 > —5/6 and aq + a 2 > —4/3 correspond 
respectively to the integrability conditions around the cusp of the cubic and the 
double tangent point. For the double tangent point, to check the integrability con¬ 
dition, one may reduce, up to an affine transformation of the plane, to check the 
integration condition for 

^-y 2 <x<y^-\-cy 3 V )l (.V d - X ^2 dxdy. 

After a few change of variables, this reduces to check the integrability condition for 
Jo y 3( '°‘ 1+a2+1 " > dy. The cusp is easier to deal with and quite immediate. 

For these measures p ai ,a 2 i we have an associated operator L QliQ2 (sharing the 
same T operator, and defined through formula (13.3)) 1 and associated orthogonal 
polynomials which are eigenvectors of L ait0 , 2 . 

We already mentioned that this model reflects in fact the symmetries of the root 
system G* 2 . In this context, the Weyl group acting on the roots has two orbits, 



22 






corresponding to the two irreducible factors of the boundary of Oi, and to the two 
parameters in the choice of the measure. When ctq = —1/2, the model is the direct 
image of the deltoid model through the projection T, and the eigenvectors of the 
associated operators are just the rewriting of P n ^ as polynomials in the variables 
s = Z + Z and p = ZZ. The hypergroup property for this model is the direct 
consequence of the previous Section El but may also be reproved directly using the 
6 dimensional model of Section [5j 

The case where aq —1/2 remains open. Let us show however how to deal with 
a different value of aq, whenever a 2 = —1/2- This relies on a very specific property 
of this G *2 polynomial model. We first observe that the domain O 2 is stable under 
the transformation 

'Ll : (s,p) (S = 3p — 1, P = 1 + s 3 — 3 ps — Gp). 

Under this transformation, the parabolic part of the boundary is mapped onto the 
cubic one, and conversely. The transformation 'Ll comes in fact from the invariance 
Z 1 —>• jZ in the deltoid model, where instead of looking at functions of (ZZ, Z + Z), 
we looked at functions of (ZZ, Z 3 + Z 3 ), under a slight change of coordinates such 
that the domain LI 2 is invariant under the transformation. 

Moreover, one may check that, when aq = —1/2, the image of the operator 
L-i/ 2 ,c *2 3 ^ 2 ,—i/ 2 - If may be easily checked looking at T(5, S),T(S, P),T(P, P), L_i/ 2 ,a 2 (&) 

and L_i/ 2 ,a 2 (-P)- There is nothing similar when aq 7 I —1/2. The transformation 
'Ll is not a diffeomorphism, and the operators L aija2 in general do not have images 
under 'Ll when aq 7 ^ —1/2. From the previous scheme, we may now conclude to the 
hypergroup property for the orthogonal polynomials associated with L a —1/2 when 
a > 0 . 
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